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This work introduces the phenomenon of Collective Almost Synchronization (CAS), which de- 
scribes a universal way of how patterns can appear in complex networks even for small coupling 
strengths. The CAS phenomenon appears due to the existence of an approximately constant local 
mean field and is characterized by having nodes with trajectories evolving around periodic stable 
orbits. Common notion based on statistical knowledge would lead one to interpret the appearance 
of a local constant mean field as a consequence of the fact that the behavior of each node is not 
correlated to the behaviors of the others. Contrary to this common notion, we show that various 
well known weaker forms of synchronization (almost, time-lag, phase synchronization, and general- 
ized synchronization) appear as a result of the onset of an almost constant local mean field. If the 
memory is formed in a brain by minimising the coupling strength among neurons and maximising 
the number of possible patterns, then the CAS phenomenon is a plausible explanation for it. 



Spontaneous emergence of collective behavior is com- 
mon in nature [ll-O- It is a natural phenomenon char- 
acterized by a group of individuals that are connected 
in a network by following a dynamical trajectory that is 
different from the dynamics of their own. Since the work 
of Kuramoto [3| , the spontaneous emergence of collective 
behavior in networks of phase oscillators with full con- 
nected nodes or with nodes connected by some special 
topologies [1| is analytically well understood. Kuramoto 
considered a fully connected network of an infinite num- 
ber of phase oscillators. If 9i is the variable describing 
the phase of an oscillator i in the network, and 6 repre- 
sents the mean field defined as 6* = J2iLi collective 
behavior appears in the network because every node be- 
comes coupled to the mean field. Peculiar characteristics 
of this collective behavior is that not only 9i ^ 9 but 
also nodes evolve in a way that cannot be described by 
the evolution of only one individual node, when isolated 
from the network. 

In contrast to collective behavior, another widely stud- 
ied behavior of a network is when all nodes behave 
equally, and their evolution can be described by an indi- 
vidual node when isolated from the network. This state 
is known as complete synchronization [6| . If a;^ represents 
the state variables of an arbitrary node i of the network 
and Xj of another node j, and x represents the mean field 
of a network, complete synchronization appears when 
for all time. The main mechanisms re- 
sponsible for the onset of complete synchronization in 
dynamical networks were clarified in [7|-l9|. In networks 
whose nodes are coupled by non-linear functions, such 
as those that depend on time-delays Q or those that 
describe how neurons chemically connect [lo| . the evo- 
lution of the synchronous nodes might be different from 
the evolution of an individual node, when isolated from 



the network. However, when complete synchronization is 
achieved in such networks. 

In natural networks as biological, social, metabolic, 
neural networks, etc, [ll|, the number of nodes is often 
large but finite; the network is not fully connected and 
heterogeneous. The later means that each node has a 
different dynamical description or the coupling strengths 
are not all equal for every pair of nodes, and one will not 
find two nodes, say it Xi and Xj, that have equal trajec- 
tories. For such heterogeneous networks, as in I12l . 
found in natural networks and in experiments [IJ], one 
expects to find other weaker forms of s ync hronous be- 
havior, such as practical synchronization [ISLjahase syn- 
chronization time-la g sy nchronization 16], and gen- 
eralized synchronization [l7| . 

We report a phenomenon that may appear in complex 
networks "far away" from coupling strengths that typi- 
cally produce complete synchronization or these weaker 
forms of synchronization. However, the reported phe- 
nomenon can be characterized by the same conditions 
used to verify the existence of these weaker forms of syn- 
chronization. We call it Collective Almost Synchroniza- 
tion (CAS). It is a consequence of the appearance of an 
approximately constant local mean field and is character- 
ized by having nodes with trajectories evolving around 
stable periodic orbits, denoted by Sp.{t), and regarded 
as a CAS pattern. The appearance of an almost constant 
mean field is associated with a regime of weak interaction 
(weak coup ling strength) in which nodes behave indepen- 
dently [ll[li]. In such conditions, even weaker forms of 
synchronization are ruled out to exist. But, contrary 
to common notion based on basic statistical arguments, 
we show that actually it is the existence of an approxi- 
mately constant local mean field that paves the way for 
weaker forms of synchronization (such as almost, time- 
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lag, phase, or generalized synchronization) to occur in 
complex networks. 

Denote all the d variables of a node i by x.^, then we 
define that this node presents CAS if the following in- 
equality 



but rather 



(1) 



is satisfied for most of the time. The double vertical bar 
I I represents that wc arc taking the absolute difference 
between vector components appearing inside the bars (LI 
norm), is a small quantity, not arbitrarily small, but 
reasonably smaller than the envelop of the oscillations of 
the variables x^ (t) . Hp . (t) is the d-dimensional CAS pat- 
tern. It is determined by the effective coupling strength 
Pi, a quantity that measures the influence on the node i 
of the nodes that are connected to it, and the expected 
value of the local mean field at the node i, denoted by 
Ci. The local mean field, denoted by Xi, is defined only 
by the nodes that are connected to the node i. The CAS 
pattern is the solution of a simplified set of equations de- 
scribing the network when x^ = C^. According to Eq. 
([1]), if a node in the network presents the CAS pattern, 
its trajectory stays intermittently close to the CAS pat- 
tern but with a time-lag between the trajectories of the 
node and of the CAS pattern. This property of the CAS 
phenomenon shares similarities with the way complete 
synchronization appears in networks of nodes coupled 
under time-delay functions Q. In such networks, nodes 
become completely synchronous to a solution of the net- 
work that is different from the solution of an isolated 
node of the network. Additionally, the trajectory of the 
nodes present a time-lag to this solution. 

The CAS phenomenon inherits the three main char- 
acteristics of a collective behavior: (a) the variables of 
a node i (x^) differ from both the mean field x and the 
local mean field x^; (b) if the local mean fields of a group 
of nodes and their effective coupling are either equal or 
approximately equal, that causes all the nodes in this 
group to follow the same or similar behaviors; (c) there 
can exist an infinitely large number of different behaviors 
(CAS patterns). 

If the CAS phenomenon is present in a network, other 
weaker forms of synchronization can be detected. This 
link is fundamental when making measurements to detect 
the CAS phenomenon. 

In Ref. (Til l, the phenomenon of almost synchroniza- 
tion is introduced, when a master and a slave in a master- 
slave system of coupled oscillators have equal phases but 
their amplitudes can be different. If a node i presents the 
CAS phenomenon [satisfying Eq. ([T|)] and n ~ in Eq. 
([1]), then the node i is almost synchronous to the pattern 

"Pi- 

Time-lag synchronization [16| is a phenomenon that 
describes two identical signals, but whose variables have 
a time-lag with respect to each other, i.e. Xi(f) = ■Xj{t — 
t). In practice, however, an equality between Xj(i) and 
Xj(t — r) should not be expected to be typically found. 
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meaning that there is not a constant r that can be found 
such that Xi(t) ~ Xj{t — r). Another suitable way of 
writing Eq. Q is by |xi(t) - Xj{t — t)| < 7. If two 
nodes i and j that present the CAS phenomenon, have 
the same CAS pattern, and ^ Tj ^0, then 



|xi(t) - Xj(t - Tij)\ < ei 



(3) 



or alternatively Xi{t) = Xj(t — Tij), for most of the time, 
Tij representing the time-lag between x^ and Xj. This 
means that almost time-lag synchronization occurs for 
two nodes that present the CAS phenomenon and that 
are almost locked to the same CAS pattern. Even though 
nodes that have equal or similar local mean field (which 
usually happens for nodes that have equal or similar de- 
grees) become synchronous with the same CAS pattern 
(a stable periodic orbit), the value of their trajectories at 
a given time might be different, since their trajectories 
reach the neighborhood of their CAS patterns in different 
places of the orbit. As a consequence, we expect that two 
nodes that exhibit the same CAS should present between 
themselves a time-lag synchronous behavior. For some 
small amounts of time, the difference |xi(i) — Xj{t — Tij)\ 
can be large, since ^ tj and 7^ e^, in Eq. ([IJ. The 
closer Xi and Xj are to C jjthe smaller is in Eq. ([3]) . 

Phase synchronization '14] is a phenomenon where the 
phase difference, denoted by A^^ , between the phases 
of two signals (or nodes in a network), (j)i{t) and 4>j{t), 
remains bounded for all time 



{i) - ^0, 



< S. 
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In Ref. 14] S — 2tt and p and q are two rational numbers. 
If p and q are irrational numbers and S" is a reasonably 
small constant, then phase synchronization can be re- 
ferred as to irrational phase synchronization |20i] . The 
value of S is calculated in order to encompass oscillatory 
systems that possess either a time varying time-scale or 
a variable time-lag. Simply make the constant S to rep- 
resent the growth of the phase in the faster time scale 
during one period of the slower time scale. Phase syn- 
chronization between two coupled chaotic oscillators was 
explained as being the result of a state where the two 
oscillators have all their unstable periodic orbits phase- 
locked [l3|. Nodes that present the CAS phenomenon 
have unstable periodic orbits that are locked to the stable 
periodic orbits described by Hi(i). If Hi(t) has a period 
Pi and the phase of this CAS pattern changes D(j)i within 
one period, so the angular frequency is uji = Dipi/Pi. If 
Hj(t) has a period Pj and the phase of its CAS patter 
changes D4>j within one period, so the angular frequency 
is LOj — D(t)j/Pj. Then, the CAS patterns of these nodes 
are phase synchronous by a ratio of ^ = uji/ujj. Since 
the trajectories of these nodes are locked to these pat- 
terns, the nodes are phase synchronous by this same ra- 
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tio, which can be rational or irrational. Assume addi- 
tionally that, as one changes the coupling strengths be- 
tween the nodes, the expected value Ci of the local mean 
field of a group of nodes remains the same. As a conse- 
quence, as one changes the coupling strengths, both the 
CAS pattern and the ratio - = ^^-rnr remain unaltered, 

^ q PiD4>j ' 

and the observed phase synchronization between nodes 
in this group is stable under parameter alterations. 

Consider a network of N nodes with nodes connected 
diffusively (more general networks are treated in the Sup- 
plementary Information) described by 

N 

Xi = F^(xi) + AyE(xj - x^), (5) 

where S SR"* is a d-dimensional vector describing the 
state variables of the node i, Fi represents the dynamical 
system of the node i, and Ay is the adjacent matrix. If 
Aij = 1, then, the node j is connected to the node i. 
E is the coupling function The degree of a node can be 
calculated by ki = J2f=i ^ij- 

The CAS phenomenon appears when the local mean 
field of a node i, Xi(t) = 1/ki AijXj, is approximately 
constant and Xi(t) ~ C.;. Then, the equations for the 
network can be described by 

X, = F,(x,) - p.,E{x,) +p^E{Ci) + S,, (6) 

where pi = aki and the residual term is 6i = pi{xi{t) — 
Ci). The CAS pattern of the node i (a stable periodic 
orbit) is calculated in the variables that produce a finite 
bounded local average field. If all components of x^ are 
bounded, then the CAS pattern is given by a solution of 

Hp, = F,(HpJ -p,^(HpJ +p,;^(Q). (7) 

which is just the same set of equations ^ without the 
residual term. So, if Xi(*) = Ci, the residual term 5i = 0, 
and if Eq. ([7]) has no positive Lyapunov exponents (Hp. 
is a stable periodic orbit), then the node Xi describes a 
stable periodic orbit. If Xi(t) — d is larger than zero 
but Hp; is a stable periodic orbit, then the node Xi de- 
scribes a perturbed version of Hp^ . The closer x^ is to 
Ci, the larger the time that Eq. ([IJ is satisfied at a 
given time. The more stable the periodic orbit is [the 
larger the largest negative Lyapunov exponents of Eq. 
d?])], the longer Eq. ^ is satisfied at a given time. 

If the network has unbounded state variables (as it is 
the case of Kuramoto networks 01), the CAS pattern 
is the periodic orbit of period Ti defined in the velocity 
space such that Hp^ [t) = Hp^ {t + Ti). 

Notice that whereas Eqs. ([5]) and (|6]) represent a Nd- 
dimensional system, Eq. ([7]) has only dimension d. 

The existence of this approximately constant local 
mean field is a consequence of the Central Limit The- 
orem, applied to variables with correlation (for more 
details, see Supplementary Information). The expected 



value of the local mean field can be calculated by 

Ci =limt^oo ^ J Xi{t)dt, (8) 

where in practice we consider t to be large, but finite. 
The larger the degree of a node, the higher is the proba- 
bility for the local mean field to be close to an expected 
value and smaller its variance. If the probability to find 
a certain value for the local mean field of the node i does 
not depend on the higher order moments of Xi(t), then 
this probability tends to be Gaussian for sufficiently large 
ki. As a consequence, the variance fi^ of the local mean 
field is proportional to k~^. 

There are two criteria for the node i to present the 
CAS phenomenon: 

Criterion 1: The Central Limit Theorem can be ap- 
plied, i.e., /zf cx k~^. Therefore, the larger the 
degree of a node, the smaller the variation of the 
local mean field Xi(t) about its expected value Ci. 

Criterion 2: The CAS pattern Hi(t) describes a stable 
periodic orbit. The node trajectory can be consid- 
ered to be a perturbed version of its CAS pattern. 
The more stable the faster trajectories of nodes 
come to the neighborhood of the periodic orbits 
(CAS patterns), and the longer they stay around 
them. 

Whenever the Central Limit Theorem applies, the ran- 
dom variables involved are independent. But, the Central 
Limit Theorem can also be applied to variables with cor- 
relation. If nodes that present the CAS phenomenon are 
locked to the same CAS pattern, their trajectories still ar- 
rive to the CAS pattern at different "random" times, al- 
lowing for the Central Limit Theorem to be applied. But 
the time-lag between two nodes (Tij ) is approximately 
constant, since the CAS pattern has a well defined pe- 
riod, and the trajectories of these nodes are locked into 
it. The local mean field measured in a node i remains un- 
altered as one changes the coupling strength either when 
the network has an infinite number of nodes (e.g. Ku- 
ramoto networks) or the nodes have a symmetric natural 
measured (See Sees. C, D, and E of Supplementary Infor- 
mation). However, as we show in the following example, 
the local mean field remains unaltered even when the 
network has only a finite number of nodes and it has a 
natural measure with no special symmetrical properties. 

As an example to illustration how the CAS phe- 
nomenon appears in a complex network, we consider 
a scaling- free network formed by, say, N — 1000 
Hindmarsh-Rose neurons, with neurons coupled electri- 
cally. The network is described by 

N 

ii = yi + - - + I + Aij {xj - Xi) 

y, = l-5xf - yi (9) 
z, = --rzi + Ar{xi + 1.618) 
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FIG. 1: [Color online] (a) Expected value of the local mean field 
of the node i against the node degree ki. The error bar indicates 
the variance (/i?) of Xi. (b) Black points indicate the value of d 
and Pi for Eq. mOI I to present a stable periodic orbit (no positive 
Lyapunov exponents). The maximal values of the periodic orbits 
obtained from Eq. I|10| l is shown in the bifurcation diagram in (c) 
considering d = -0.82 and a = 0.001. (d) The CAS pattern for a 
neuron i with degree ki=25 (with cr = 0.001 and C = —0.82). In 
the inset, the same CAS pattern of the neuron i and some sampled 
points of the trajectory for the neuron i and another neuron j with 
degree kj = 25. (e) The difference between the first coordinates of 
the trajectories of neurons i and j, with a time-lag of Tij = 34.2. (f) 
Phase difference between the phases of the trajectories for neurons 
i and j. 



where 7=3.25 and r=0.005. The first coordmate of the 
equations that describe the CAS pattern is given by 

S^^ = Ey^ + 3-1^ - - E,^ + h -P^^x, +P^C^. (10) 

The others are given by Ey^ = 1 — S^. — Ey., E^. = 
—rEz- + 4:r{Exi + 1.618). In this network, we have nu- 
merically verified that criterion 1 is satisfied for neurons 
that have degrees > 10 if tr < ct*, with a* = 0.001. In 
Fig. [Ha), we show the expected value Ci of the local 
mean field of the first coordinate Xi of a neuron i with 
respect to the neuron degree (indicated in the horizontal 
axis), for a — 0.001. The error bar indicates the variance 
of Ci which fits to oc k~^ '^^'^^. In (b), we show a parame- 
ter space to demonstrate that the CAS phenomenon is a 
robust and stable phenomenon. Numerical integration of 
Eqs. ® for Pi G [0.001,1] produces C, G [-0.9,0.7]. 
We integrate Eq. dTU]) by using d G [-0.9,0.7] and 
Pi G [0,0.2], to show that the CAS pattern is stable 
for most of the values. So, variations in Ci of a net- 
work caused by changes in a parameter do not modify 
the stability of the CAS pattern calculated by Eq. (ITUl) . 
For a = 0.001, Eqs. (O yields many nodes for which 



Xi = —0.82. So, to calculate the CAS pattern for these 
nodes, we use Q = -0.82 and a = 0.001 in Eqs. pil|) . 
The CAS pattern obtained, as we vary pi, is shown in the 
bifurcation diagram in (c) , by plotting the local maximal 
points of the CAS patterns. Criterion 2 is satisfied for 
most of the range of values of pi that produces a stable 
periodic CAS pattern. A neuron that has a degree ki 
is locked to the CAS pattern calculated by integrating 
Eqs. pO)) using kia = pi and the measured expected 
value for the local mean field, Q. In (d), we show the 
periodic orbit corresponding to a CAS pattern associated 
to a neuron i with degree ki — 25 (for cr=0.001) and in 
the inset the sampled points of the trajectories of this 
same neuron i and of another neuron j that has not only 
equal degree (fcj=25), but it feels also a local mean field 
of Cj = —0.82. In (e), we show that these two neurons 
have a typical time-lag synchronous behavior. In (f), we 
observe p/g = 1 phase synchronization between these two 
neurons for a long time, considering that the phase dif- 
ference remains bounded by S" = 6 x 27r as defined in Eq. 
(|^ , where the number 6 is the number of spikings within 
one period of the slower time-scale. In order to verify Eq. 
(HI) for all time, we need to choose a ratio that is approxi- 
mately equal to 1 (p/q = 1), but not exactly 1 to account 
for slight differences in the local mean field of these two 
neurons. Since Ci depends on a for networks that have 
neurons possessing a finite degree, we do not expect to 
observe a stable phase synchronization in this network. 
Small changes in a may cause small changes in the ratio 
p/q. Notice however that Eq. ^ might be satisfied for 
a very long time, for p/q — 1. If neurons are locked to 
different CAS patterns (and therefore have different lo- 
cal mean field), Eqs. ([T]) and Q are both satisfied, but 
phase synchronization will not be 1:1, but with a ratio 
oip/q (see Sec. E in Supplementary Information for an 
example) . 

If neurons in this scaling-free network become com- 
pletely synchronous, it is necessary that (t{N) > 
2a^^{N = 2)/|A2| (Ref. 0). a^^{N = 2) ^ 0.5 
represents the value of the coupling strength when two 
bidirectionally coupled neurons become completely syn- 
chronous. A2 = —2.06 is the largest non-positive eigen- 
value of the Laplacian matrix defined as Aij — diag(/cj). 
So, crC^(iV) > 1/2.06 ^ 0.5. The CAS phenomenon 
appears when cr'^^'5(7V = 1000) < 0.001, a coupling 
strength 500 times smaller than the one which produces 
complete synchronization. Similar conclusions would be 
obtained when one considers networks of different sizes, 
with nodes having the same dynamical descriptions and 
same connecting topology. 

Concluding, in this work we introduce the phenomenon 
of Collective Almost Synchronization (CAS), a phe- 
nomenon that is characterized by having nodes possess- 
ing approximately constant local mean fields. The ap- 
pearance of an approximately constant mean field is a 
consequence of a regime of weak interaction between the 
nodes responsible to place the node trajectory around 
stable periodic orbits. A network has the CAS phe- 
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nomenon if the Central Limit Theorem can be apphed, 
and it exists an approximately constant mean field. In 
other words, the CAS is invariant to changes in the 
value of the expected value of the local mean field, that 
might appear due to parameter alterations (e.g. coupling 
strength). If the expected value of the local field changes, 
but the Central limit Theorem can still be applied, nodes 
of the network will present the CAS phenomenon and 
the observed weak forms of synchronization among the 
nodes might (or not) be preserved. As examples of how 
common this phenomenon could be, we have asserted its 
appearance in a large networks of chaotic maps (see sup- 
plementary information), Hindmarsh-Rose neurons, and 
Kuramoto oscillators (see supplementary information). 
In the Supplementary Information, we also discuss that 
the CAS phenomenon is a possible source of coherent 
motion in systems that are models for the appearance of 
collective motion in social, economical, and animal be- 
haviour. 



I. SUPPLEMENTARY INFORMATION 
A. CAS and generalized synchronization 



alized synchronization occurs whenever there is at least 
one node whose modified dynamics is periodic. All the 
nodes that have a stable and periodic modified dynam- 
ics become synchronous in the generalized sense with the 
nodes that have a chaotic modified dynamics. The gen- 
eral theorem presented in Ref. is a powerful tool for 
the understanding of weak forms of synchronization or 
desynchronous behaviors in complex networks. However, 
identifying the occurrence of generalized synchronization 
does not give much information about the behavior of 
the network, since the function that relates the trajec- 
tory among the nodes that are generalized synchronous 
is usually unknown. The CAS phenomenon allows one 
to calculate, at least in an approximate sense, the equa- 
tions of motion that describes the pattern to which the 
nodes are locked to. More specifically, we can derive the 
set of equations governing, in an approximate sense, the 
time evolution of the nodes, not covered by the theorem 
in Ref. ^24J. 

Finally, if there is a node whose modified dynamics de- 
scribes a stable periodic behavior and its CAS pattern is 
also a stable periodic stable behavior, then the CAS phe- 
nomenon appears when the network presents generalized 
synchronization. 



Generalized svnchronization [2]1| is a common be- 
havior in complex networks [22'-'24'], and should be ex- 
pected to be found typically. This phenomenon is defined 
as Xi — $(yi), where $ is considered to be a continu- 
ous function. As explained in Refs. [13, [HI, generalized 
synchronization appears due to the existence of a low- 
dimensional synchronous manifold, often a very compli- 
cated and unknown manifold. 

Recent works [l^, [13, [IE [111 have reported that nodes 
in the network that are highly connected become syn- 
chronous. As shown in ref. j23l ] , th at is a manifestation 
of generalized synchronization [13, [2l| in complex net- 
works. For a fixed coupling strength among the nodes 
with heterogeneous degree distributions and for the usual 
diffusively coupling configuration one should expect that 
the set of hub nodes (highly connected nodes) provides a 
skeleton about which synchronization is developed. Ref- 
erence 27| demonstrates how ubiquitous generalized syn- 
chronization is in complex networks. It is shown that 
a necessary condition for its appearance in oscillators 
coupled in a driven-response (master-slave) configuration 
is that the modified dynamics of the response system 
presents a stable periodic behavior. The modified dy- 
namics is a set of equations constructed by considering 
only the variables of the response system. In a complex 
network, a modified dynamics of a node is just a system 
of equations that contains only variables of that node. 

An important contribution to understand why gener- 
alized synchronization is a ubiquitous property in com 
plex network is given by the numerical work of Ref. 
and the theoretical work of Ref. 24 1. In Refs. [23 
the ideas of Ref. [l^ are extended to complex networks 
In particular, the work of Ref. [2^ shows that gener- 
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B. CAS and other synchronous and 
weak-synchronous phenomena 

Consider a network of N nodes described by 

N 

X, ^ F,(x,) + A,jE[?^(xj - X,)] + C.(0, (11) 

where £ 3?'^ is a d-dimensional vector describing the 
state variables of the node i, F^ is a d-dimensional vector 
function representing the dynamical system of the node i, 
Aij is the adjacent connection matrix, E is the coupling 
function as defined in [3l , H is an arbitrary diffcrcntiable 
transformation, and (^i{t) is an arbitrary random fiuctu- 
ation. Assume in the following that C,i{t) = 0. 

Assume that the nodes in the network ([TT|) have equal 
dynamical descriptions, i.e., F^ = F, that the network is 
fully connected, so every node has a degree ki = N — 1, 
and that 'H(xj — = (xj — x^). We can rewrite it in 



terms of the average field x(t) = ^iit)- 
X., = Fi(x.,) - p^E(xi - x). 



(12) 



where pi — crki. Therefore every node becomes "decou- 
pled" from the network in the sense that their interaction 
is all mediated by the average field. Collective behavior 
is dictated by the behavior of the average field and the 
individual dynamics of the node. The linear stability of 
the network ([T2|) was used in Ref. [l^] as an approxi- 
mation to justify how desynchronous behavior about the 
average field can appear in complex networks. Notice 
that this assumption can only be rigorously fulfilled if 
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the network is fully connected and, therefore, it is nat- 
ural to understand why the desynchronous phenomena 
reported in Ref. [13] happens for nodes that are highly 
connected. One can interpret the desynchronous behav- 
ior observed in Ref. 12] as an almost synchronization 
between a node and the mean field x. 

The differences between complete synchronization and 
synchronization in the collective sense can be explained 
through the following example. An interesting solution 
of Eq. can be obtained when x = Xi(t), Xi(i) 

varying in time. In this case, the average field is along 
the synchronization manifold. The network being com- 
pletely synchronous, all nodes having equal trajectories, 
and Fi{xi{t)) = Xi(i). For such a special network, collec- 
tive behavior and complete synchronization are the same. 
On the other hand, collective behavior typically appears 
when the coupling term (Ti?(xi — x) is different from zero 
for most of the time and Fj(xi) ^ Xj, but there is a 
majority of nodes with similar behavior. In this sense, 
the desynchronous behaviors reported in Ref. [11] can 
be considered as a collective phenomena that happens to 
parameters close to the ones that yields complete syn- 
chronization. 

To understanding when the CAS phenomenon occurs, 
consider the solution of Eq. (IT^ in the thermodynamics 
limit N ^ oo when x is a constant in time, x = C. For 
such a situation, the evolution of a node can be described 
by the same following d-dimensional system of ODEs 

i = F(x)-pE(x-C), (13) 

where p — a{N — 1). If complete synchronization takes 
place, then Fi(C) = 0, meaning that there can only ex- 
ist complete synchronization if all the nodes lock into 
the same stable steady state equilibrium point, likely to 
happen if F^ is the same for all the nodes. 

Another possible network configuration that leads to 
x = C happens when each node is only weakly coupled 
("independent") with the others such that the Central 
Limit Theorem could be applied. If the network has only 
a finite number of nodes and x(t) is not exactly constant 
in time, but x(t) ~ C, the nodes still behave in the same 
predictable way if the dynamics described by x = F(x) — 
pE(x)-|-pE(C) is a sufficiently stable periodic orbit. This 
is how the CAS phenomenon appears in fully connected 
networks. All nodes become locked to the stable periodic 
orbit described by x = F(x) -pE(x) -|-pE(C). 

Now, we break the symmetry of the network, allowing 
the nodes to be connected arbitrarily to their neighbors. 
We still consider diffusive linear couplings, 'H(xj — x^) = 
(xj — Xi). The equations of such a network can be written 
as 

= F,(x,0 -p,E(x,) +p»E(x,(t)), (14) 

where ki is the degree of node i with ki < km, ii I < m, 
and Xi{t) is the local mean field defined as 

1 ^ 



Our main assumption is that the local mean field of 
a variable that is bounded, either Xi(t) or Xi(i), exhibits 
small oscillations about an expected constant value C. In 
other words, one can define a time average C by either 

= i / Mt)dt, (16) 
t Jo 

or 

C, = i / Mt)dt. (17) 
t Jo 

Notice that x^ e K'^ (or x^ G 5R''), and so does C 
The CAS phenomenon appears for a node that has at 
least one component of the local mean field (x^ or x^) 
that is approximately constant. The appearance of this 
almost constant value is a consequence of the Central 
Limit Theorem. For networks whose nodes are described 
by only bounded variables, when calculating the local 
mean field we only take into consideration the component 
receiving the couplings from other nodes. For networks 
of Kuramoto oscillators that have one variable (the phase 
9) that is not bounded, a constant local mean field ap- 
pears in the component that describes the instantaneous 
frequency {Oj). 

In Ref. [24], it was shown that for chaotic networks 
described by a system of equations similar to Eq. (jl4l) , 
generalized synchronization can appear if the modified 
dynamics described by x^ = Fi{xi) — akiE{xi) of a cer- 
tain number of nodes are either stable equilibrium points 
(xi=0) or they describe stable periodic solutions (limit 
cycle). Generalized synchronization appears between the 
nodes that have modified dynamics describing stable pe- 
riodic states and the nodes that have modified dynamics 
describing chaotic states. 

To understand the phenomenon of collective almost 
synchronization (CAS), introduced in this work, consider 
that 'Hi'x.j — Xi) — (xj — Xi). It is a phenomena that 
appears necessarily when Xi ~ d or x^ « C^. The equa- 
tions for the network can then be described by 

X, = F,(x,) - p,E(x,) + p,E{C^) + S,, (18) 

where the residual term is Si — Pi{^i — Ci). This term 
is small most of the time but large for some intervals of 
time; 5i(t) > for all time, but 5i{t) < e for most of the 
times. Another requirement for the CAS phenomenon to 
appear is that the CAS pattern Hi(t) of a node i that is 
described by Eq. ([18]) ignoring the residual term 

H, =F,(H,)-p,E(H,)-Hp,E(Q). (19) 

must be a stable periodic orbit. We define that a node 
presents collective almost synchronization (CAS) if 

]x,(0 -H,(t-T,)l < e„ (20) 

for most of the time, 



7 



Notice from Eq. ([19]) that for pi > 0, the CAS pattern 
will not be described by F(xi) and therefore does not be- 
long to the synchronization manifold. On the other hand, 
Hi is induced by the local mean field as typically happens 
in synchronous phenomenon due to collective behavior. 
This property of the CAS phenomenon shares similarities 
with the way complete synchronization appears in net- 
works of nodes coupled under time-delay functions [9J . In 
such networks, nodes become completely synchronous to 
a solution of the network that is different from the solu- 
tion of an isolated node of the network. Additionally, the 
trajectory of the nodes present a time-lag to this solution. 

To understand the reason why the CAS phenomenon 
appears when Hi(i) is a sufficiently stable periodic orbit, 
we study the variational equation of the CAS pattern 
(Ull) 



reasonably small constant, that can be larger than 27r in 
order to encompass oscillatory systems that either have a 
time varying time-scale or whose time-lag varies in time. 
This bound can be simply calculated by making S to 
represent the growth of the phase in the faster time scale 
after one period of the slower time scale. 

The link between the CAS phenomenon and phase syn- 
chronization can be explained by thinking that it is a 
synchronous phenomenon among the nodes that is me- 
diated by their CAS patterns. The phase of the peri- 
odic orbit of the CAS pattern of the node i grows as 
(j)i{t) = ujit + (,i{t) + (f>^ and of the node j grows as 
(j)j{t) — ujjt + ^j{t) + (fpy The quantities 0° and (jP^ are 
displacements of the phase caused by the existence of 
time-lag, and ^i(t) and £,j{t) are small fluctuations. For 
t ^ oo these can be neglected and we have that 



6 = [OT,(6)-p^E]e;. 



(21) 



obtained by linearizing Eq. (jl9p around by making 
= Xi — Hi. This equation produces no positive Lya- 
punov exponents. As a consequence, neglecting the exis- 
tence of the time-lag between Xi(t) and H(t)i, the trajec- 
tory of the node i oscillates about H^, and x^ — H^ < e^, 
for most of the time, satisfying Eq. d^U]) . where de- 
pends on 5i. If there are two nodes i and j, which feel 
similar local mean fields, H^ ~ H^ , then x^ ~ Xj, for most 
of the time. 

To understand why the nodes that present CAS have 
also between them a time-lag type of synchronization, 
integrate Eq. using Eq. to obtain 



,{t) + 5,{t)]dt. 



(22) 



This integral is not trivial in the general case. But we 
have a simple phenomenological explanation for its solu- 
tion. When the CAS pattern is sufficiently stable, the 
asymptotic time limit state of the variable Xi(t) is the 
CAS pattern Hi(t). But due to the residual term 5i{t), 
the trajectory of Xi(<) arrives in the neighborhood of H(i) 
at time t with a time-lag. As a result, nodes that are col- 
lectively almost synchronous obey Eq. (^01 . In addition, 
two nodes that present CAS have also a time-lag between 
their trajectories for the same reason. There is an extra 
contribution to the time-lag between the trajectories of 
two nodes if their initial conditions differ. 

Phase synchronization [l3| is a phenomena where the 
phase difference, denoted by A(/)y between the phases 
of two signals (or nodes in a network), 4)i{t) and 4)j{t), 
remains bounded for all time 



A(f>ij = 



< s, 



(23) 



where S = 27r, and p and q are two rational numbers 
[l3 |. For coupled chaotic oscillators one can also find 
irrational phase synchronization j20| , where Eq. (j23l) can 
be satisfied for all time with p and q irrational. S* is a 



hit) 



p 

1 



(24) 



where uji = limt_^oo ^^7^ gives the average frequency of 
oscillation of the CAS pattern of node i, and p and q are 
two real numbers. 

The phase of the nodes can be written as a function of 
the phase of the periodic orbits of the CAS pattern. So, 
(bit), = f{t)^ + 5(j),{t) and 4>{t)j = f{t)^ + Scj)^it), S,{t) 
represents a variation of the phase of the node i with 
respect to the phase of the CAS pattern, and depends on 
the way the phase is defined [28]. The phase difference 
A(f)ij (i), as written in Eq. ()23|) . becomes equal to \t{quJi — 
pujj)+qSt(t)-pS4)j{t)\. But, fromEq. quj^-pujj — 0, 

and therefore, A(j)ij{t) < ma:x: {q5(f>i{t) — pS(l)j{t)). But 
since the node orbit is locked to the CAS pattern, Aipij (t) 
is always a small quantity. 

In practice, for networks composed by a finite number 
of nodes, we do not expect that the quantities 5(j)i{t) and 
5(j)j (t) to remain small for all the time. The reason is that 
the CAS pattern can only be approximately calculated 
and in general we do not know the precise real value of 
the local mean field. However, our simulations show that 
these quantities remain small for time intervals that com- 
prise many periods of oscillations of the node trajectories. 
For networks having an expected value of the mean field 
Ci that is independent on the coupling strength cr, the 
ratio p/q does not change as one changes the value of tr, 
and then phase synchronization is stable under a param- 
eter variation. For the network of Kuramoto oscillators, 
Eq. can be verified for all time with a value oi p/q 
that remains invariant as one changes a. 

Assume for now that the nodes have equal dynamics, 
so F; = F. If a node i with degree ki has a periodic 
CAS pattern that is sufficiently stable under Eq. (|2ip . 
all the nodes with degrees close to ki also have similar 
CAS patterns that are sufficiently stable under Eq. (PT|) . 
Node i is locked to H^ and node j is locked to H^. But 
since H^ is approximately equal to Hj, thus, x^ = Xj, for 
most of the time. So, if the pattern solution is sufficiently 
stable, the external noise C,i{t) can be different from zero. 
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and still have similar trajectories for that interval of time. 
The same argument remains valid if ^ Y j , as long as 
the CAS pattern is sufficiently stable. 

In Ref. poj . synchronization was defined in terms of 
the node xjv that has the largest number of connections, 
when Xi{t) = xat (which is equivalent to stating that 
\x.i{t) — xjvl < e), where xjv is assumed to be very close 
to the synchronization manifold s defined by s = F(s). 
This type of synchronous behavior was shown to exist in 
scaling free networks whose nodes have equal dynamics 
and that are linearly connected. This was called hub 
synchronization. 

The link between the CAS phe nomenon with the hub 
synchronization phenomenon [26|, and generalized syn- 
chronization can be explained as in the following. It is 
not required for nodes that present the CAS phenomenon 
for their error dynamics Xj — x.; to be small. But for the 
following comparison, assume that Xj — x^ is small 

so that we can linearise Eq. about another node j. 
Assume also that Fj = F. The variational equations of 
the error dynamics between two nodes i and j that have 
equal degrees are described by 

= [i^F(x,;) - p^E]^,, + ri,. (25) 

In Ref. [2^, hub synchronization exists if Eq. (I^5t . 
neglecting the coupling term 77.;, has no positive Lya- 
punov exponents. That is another way of stating that 
hub synchronization between i and j occurs when the 
variational equations of the modified dynamics [x^ — 
F(xi)— pii?(xi)] presents no positive Lyapunov exponent. 
In other words, in order to have hub synchronization it 
is necessary that the modified dynamics of both nodes 
be describable by stable periodic oscillations. Hub syn- 
chronization is the result of a weak form of generalized 
synchronization, defined in terms of the linear stability of 
the error dynamics between two highly connected nodes. 
Unlike generalized synchronization, hub synchronization 
offers a way to predict, in an approximate sense, the tra- 
jectory of the synchronous nodes. 

In contrast, the CAS phenomenon appears when the 
CAS pattern, which is different from the solution of 
the modified dynamics, becomes periodic. Another dif- 
ference between the CAS and the hub synchronization 
phenomenon is that whereas Xi ~ C in the CAS phe- 
nomenon, Xi ~ Xi in the hub synchronization, in order 
for rji to be very small, and x^ to be close to the synchro- 
nization manifold. So, whereas hub synchronization can 
be interpreted as being a type of practical synchroniza- 
tion [l5|, CAS is a type of almost synchronization. 

In the work of Refs. [29|, H^l, it was numerically re- 
ported a new desynchronous phenomenon in complex 
networks. The network has no positive Lyapunov expo- 
nents but it presents a desynchronous non-trivial collec- 
tive behavior. A possible situation for the phenomenon 
to appear is when 5i and Ci in Eq. (|T8l) are either zero 
or sufficiently small such that the stability of the net- 
work is completely determined by Eq. (j2ip . and this 
equation produces no positive Lyapunov exponent. As- 



sume now that pi in Eq. (|I9p is appropriately adjusted 
such that the CAS pattern for every node i is a sta- 
ble periodic orbit. The variational Eqs. (|2T|) for all 
nodes have no positive Lyapunov exponents. If addi- 
tionally, Xi(t) ~ C, then the network in Eq. (IT4l) pos- 
sesses no positive Lyapunov exponent. Therefore, net- 
works that present the CAS phenomenon for all nodes 
might present the desynchronous phenomenon reported 
in Refs. ^9|,|33|. The CAS phenomenon becomes differ- 
ent from the phenomenon of Refs.jl^, 1131 if for at least 
one node, Eq. ([TO]) produces a chaotic orbit. 

To understand the occurrence of CAS in networks 
formed by heterogeneous nodes connected by nonlinear 
functions such as networks of Kuramoto oscillators, we 
rewrite the Kuramoto's network model in terms of the lo- 
cal mean field, 6i = ^ '^^=1 ^ij^J- Using the coordinate 
transformation 

^ J2 A^, exp = h exp (26) 

3=1 

the dynamics of the node i is described by 

bJi+PifisiniOi- di). (27) 

The phase 9i is not a bounded variable and therefore 
we expect that typically Oi has not a well defined aver- 
age. But, 9i{t) is bounded and has a well defined aver- 
age value which is an approximately constant quantity 
(Ci) for nodes in networks with sufficiently large num- 
ber of connections and with sufficiently small coupling 

strengths. When 9i = Ci, the node i has the propensity 
to exhibit the CAS phenomenon, and the CAS pattern is 
calculated by Eq. (P7)) considering that 9i = dt. Notice 

that Fi = 9,t'=^ C^t. 

Phase synchronization between two nodes in the net- 
works of Eq. (|27p is stable under parameter varia- 
tions (coupling strength in this case) if these nodes 
present the CAS phenomenon. There is irrational (ra- 
tional) phase synchronization if £i is irrational (ratio- 
nal). If nodes are sufficiently "decoupled" we expect 
that = ~ (jji/ujj. Phase synchronization will be ratio- 

nal whenever nodes with different natural frequencies be- 
come locked to Arnold tongues's, induced by the coupling 
PifiSin(9i - 9i). 

There is a special solution of Eq. (|27|) that produces 
a bounded state in the variable 9i when the network is 
complete synchronous to an equilibrium point. In such 
case, 9i becomes constant, and Eq. (|27l) has one stable 

equilibrium 9i = arcsin^^^, obtained when pi > w^. 

But, the local mean field becomes constant due to com- 
plete synchronization and not due to the fact that the 
nodes are "decoupled" . These conditions do not produce 
the CAS phenomenon. 

We take the thermodynamics limit when the network 
has infinite nodes with infinite degrees. Ci calculated 
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using Eq. (|17l) does not change as one change the 
couphng (T, since 9i = \imki,N^oo ^[Y,j'=i ^iji^i + 
Pinsin{9i - Oi))]=limk^^N^oo ^[J2j=i^ij^3] + 

cfY^^=i ^iji^j^i^i.^] ~ ^i))- But, if nodes are sufficiently 
decoupled X^jLi A.ij{fjsin{9j — 9i)) approaches zero, and 
therefore, Cj only depends on the natural frequencies: 

9i = Ci = -E-EjLi ^ij'^j]- 

Assume that there are two nodes, i and j, and that for 
most of the time ~ Sj . Then, for most of the time it is 
also true that Si — 0i ~ 5 j — 9j , which allow us to write 
that sm(*j - 9j) - sin{^i - 9{) ~ cos(*j - 6'j)[(*j - 
9,) - i^j - 9j)] « cos - 9,)[9j - 9j]. Since « 9„ 
then cos — 9i) ^ 1 and sin{^ j — 9j) — sin{'^i — 9i) ~ 
[9j — 9j\. Defining the error dynamics between the two 
nodes to be ^ij — 9j — 9i, we arrive that 

~ (wj - uji) ~ pi^^j. (28) 

Therefore, it implies that we expect to find two nodes 
having the same similar CAS behavior when both the 
local mean field is close and when the difference between 
their natural frequencies (wj — (^i) is small. 

The CAS phenomenon can also appear in a system of 
driven particles (3lj | that is a simple but powerful model 
for the onset of pattern formation in population dynam- 
ics 3: economical systems [111 and social systems 
In the work of Ref. [Slj, it was assumed that individ- 
ual particles were moving at a constant speed but with 
an orientation that depends on the local mean field of 
the orientation of the individual particles within a local 
neighborhood and under the effect of additional external 
noise. Writing an equivalent time-continuous description 
of the Vicsek particle model [3l|, the equations of mo- 
tion for the direction of movement of a particle i, can be 
written as 

x, = -X, + X, + A6l„ (29) 

where x^ represents the local mean field of the orientation 
of the particle i within a local neighborhood and A9i 
represents a small noise term. When x; is approximately 
constant, the CAS pattern is described by a solution of 
Xi = — Xi + Xi, which will be a stable equilibrium point as 
long as A9i is sufficiently small. From the Central Limit 
Theorem, x^ will be approximately constant as long as 
the neighborhood considered is sufficiently large or the 
density of particles is sufficiently large. 

C. About the expected value of the local mean 
field: the Central Limit Theorem 

The Theorem states that, given a set of t observa- 
tions, each set of observation containing k measurements 
{xi,X2,X3,X4,...,Xk), the sum Sn = Y!l^iXi[N) (for 
N = 1, 2, . . . , t), with the variables Xi{N) drawn from an 



independent random process that has a distribution with 
finite variance and mean converges to a Normal dis- 
tribution for sufficiently large k. As a consequence, the 
expected value of these t observations is given by the 
mean x (additionally, x — \ Y1^n=i^n), and the vari- 

2 

ance of the expected value is given by The larger 
the number k of variables being summed, the larger is 
the probability with which one has a sum close to the 
expected value. There are many situations when one can 
apply this theorem for variables with some sort of cor- 
relation 33], as it is the case for variables generated by 
deterministic chaotic systems with strong mixing prop- 
erties, for which the decay of correlation is exponentially 
fast. In other words, a deterministic trajectory that is 
strongly chaotic behaves as an independent random vari- 
able in the long-term. For that reason, the Central Limit 
Theorem holds for the time average value x{t) produced 
by summing up chaotic trajectories from nodes belonging 
to a network that has nodes weakly connected. Conse- 
quently, the distribution of Xi{t) = j^'Ylij -^ij^ji^^) fo^' 
node i should converge to a Gaussian distribution cen- 
tered aX Ci = J J^Xi{t)dt as the degree of the node is 
sufficiently large. In addition, the variance of the 
local mean field x{t)i decreases proportional to k~^ , as 
we have numerically verified for networks of Hindmarsh- 
Rose neurons (/if cx fcj~"'^ °°^^) and networks of Kuramoto 
oscillators (//f oc fc~^-°^^). 

If the network has no positive Lyapunov exponents, we 
still expect to find an approximately constant local mean 
field at a node i, as long as the nodes are weakly con- 
nected and its degree is sufficiently large. To understand 
why, imagine that every node in the network stays close 
to a CAS pattern and one of its coordinates is described 
by sin{uJit). Without loss of generality we can make that 
every node has the same frequency cji — uj. The time- 
lag property in the node trajectories, when they exhibit 
the CAS pattern, results in that every node is close to 
siniuJit) but they will have a random time-lag in relation 
to the CAS pattern (due to the decorrelated property be- 
tween the node trajectories). So, the selected coordinate 
can be described by sin{ujt + + Si{t), where 0° is a 
random initial phase and Si(t) is a small random term 
describing the distance between the node trajectory and 
the CAS pattern. Neglecting the term Si{t), the distribu- 
tion of the sum Yli=i siniiot + (p^) converges to a normal 
distribution with a variance that depends on the variance 
of sin{4>^). 

From previous considerations, if the degree of some of 
the nodes tend to infinite, the variance of the local mean 
field for those nodes tends to zero and, in this limit, the 
residual term 5i in Eq. ([T8)) is zero and the local mean 
field of these nodes is a constant. As a consequence, the 
node is perfectly locked with the CAS pattern (e = in 
Eq. (HOI)). 
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D. CAS in a network of coupled maps 

As another example to illustrate how the CAS phe- 
nomenon appears in a complex network, we consider a 
network of maps whose node dynamics is described by 
Fi{xi) — 2xi mod(l). The network composed, say, by 
N — 1000 maps, is represented by xf'^'^'^ — Fi{x'f^'^) + 
cr^^j^ — a;|"'') mod(l), where the upper index 

n represents the discrete iteration time, and is the 
adjacency matrix of a scaling-free network. The map 
has a constant probability density. When such a map 
is connected in a network, the density is no longer con- 
stant, but still symmetric and having an average value 
of 0.5. As a consequence, nodes that have a sufficient 
amount of connections (fc > 10) feel a local mean field, 
say, within [0.475, 0.525], (deviating of 5% about Ci=0.5) 
and /Lt| oc fc~^ (criterion 1), as shown in Fig. ^a). 
Therefore, such nodes have propensity to present the 
CAS phenomenon. In (b) we show a bifurcation dia- 
gram of the CAS pattern, S^, obtained from Eq. 
by using Ci = C = 0.5, as we vary pi. Nodes in this 
network that have propensity to present the CAS phe- 
nomenon will present it if additionally pi 6 [1,3]; the 
CAS pattern is described by a period-2 stable orbit (cri- 
terion 2). This interval can be calculated by solving 
|2 — Pi| < 1. In (c) we show the probability density func- 
tion of the trajectory of a node that present the CAS 
phenomenon. The density is centered at the position of 
the period-2 orbit of the CAS pattern and for most of the 
time Eq. (I^Ul) is satisfied. The filled circles are fittings 
assuming that the probability density is given by a Gaus- 
sian distribution. Therefore, there is a high probability 
that Ei in Eq. (I^Uj) is small. In (d) we show a plot of 
the trajectories of two nodes that have the same degree 
which is equal to 80. We chose nodes which present no 
time-lag between their trajectories and the trajectory of 
the pattern. If there was a time-lag, the points in (d) 
would not be only aligned along the diagonal (identity) 
line, but they would also appear off-diagonal. 

E. CAS in the Kuramoto network 

An illustration of this phenomenon in a network com- 
posed by nodes having heterogeneous dynamical descrip- 
tions and a nonlinear coupling function is presented in a 
random network of iV=1000 Kuramoto oscillators. We 
rewrite the Kuramoto network model in terms of the lo- 
cal mean field, 6i ~ ^ ^ij^i- Using the coordinate 

transformation ^ ^^-^ exp-''^^^"^') = exp-'^^'"^'', 
the dynamics of node i is described by 

9i^ijji+ pifisin(9i - Oi), (30) 

where cji is the natural frequency of the node i, taken 
from a Gaussian distribution centered at zero and with 
standard deviation of 4. If fi=l, all nodes coupled to 
node i are completely synchronous with it. If fi=0, there 
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FIG. 2: (a) Expected value of the local mean field of the node i 
against the node degree ki. The error bar indicates the variance 
(/i^) of Xi. (b) A bifurcation diagram of the CAS pattern [Eq. 
| |19| |] considering d = 0.5. (c) Probability density function of the 
trajectory of a node with degree fei=80 (therefore, pi = crki = 1.3, 
(T = 1.3/80). (d) A return plot considering two nodes {i and j) 
with the same degree ki = kj =80. 



is no synchronization between the nodes that are cou- 
pled to the node i. Since the phase is an unbounded 
variable, the CAS phenomenon should be verified by the 
existence of an approximate constant local mean field in 
the frequency variable 9i. If 9i{t) = Ci, which means that 

9i — 9it = dt, then Eq. (PU)) describes a periodic orbit 
(the CAS pattern), regardless the values of uji, pi, and fi, 
since it is an autonomous two-dimensional system; chaos 
cannot exist. Therefore, criterion 2 is always satisfied in 
a network of Kuramoto oscillators. We have numerically 
verified that criterion 1 is satisfied for this network for 
a < cr^^^(iV = 1000), where cr'^^^(iV = 1000) ^ 0.075. 
Complete synchronization is achieved in this network for 
a > a'-^^ = 1.25. So, the CAS phenomenon is observed 
for a coupling strength that is 15 times smaller than the 
one that produces complete synchronization. 

For the following results, we choose a — 0.001. Since 
the natural frequencies have a distribution centered at 
zero, it is expected that, for nodes with higher degrees, 
the local mean field is close to zero (see Fig. |3ta)). In 
(b), we show the variance of the local mean field of the 
nodes with degree ki. The fitting produces /if oc fc"^"^^ 
(criterion 1). In (c), we show the relationship between 
the value of pifi and the value of the degree ki. In or- 
der to calculate the CAS pattern of a node with degree 
ki, we need to use the value of Pifi (which is obtained 
from this figure) and the measured Ci as an input in 
Eq. ([50]) . We pick two arbitrary nodes, i and j, with 
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FIG. 3: Results for a = 0.001. (a) Expected value of the local 
mean field 9i of a node with degree ki. (b) The variance of the 
local mean field, (c) Relationship between the value of pifi and ki. 
(d) Phase difference Acpij = 6i —p/q6j between two nodes, 
one with degree ki = 96 and the other with degree kj = 56; 
the phase difference 5(j)i — 9i — He. between the phases of the 
trajectory of the node i with degree ki = 96 and the phase of 
its CAS pattern. 

degrees hi ~ 96 and kj — 56, respectively, with natural 
frequencies Wi ~ —5.0547 and ujj ~ —5.2080. In (d), 
we show that phase synchronization is verified between 
these two nodes, with p/q — Wi/wj. We also show the 
phase difference 6(j)j = 6j — Sg^. between the phases of 
the trajectory of the node i with degree kj = 96 and the 
phase of its CAS pattern, for a time interval correspond- 
ing to approximately 2500/P cycles, where the period of 
the cycles in node i is calculated by P = bWIt- Phase 
synchronization between nodes i and j is a consequence 
of the fact that the phase difference between the nodes 
and their CAS patterns is bounded. 

In the thermodynamic limit, when a fully connected 
network has an infinite number of nodes, Ci does not 
change as one changes the coupling tr, since it only de- 
pends on the mean field of the frequency variable (9). 
As a consequence, if there is the CAS phenomenon and 
phase synchronization between two nodes with a ratio of 
p/q for a given value of cr, changing a does not change 



the ratio p/q. Therefore phase synchronization is stable 
under alterations in a. Phase synchronization will be ra- 
tional and stable whenever nodes with different natural 
frequencies uJi become locked to Arnold tongues [13, Issj 
induced by the coupling pifisin{9i — 9/). 

There is a special solution of Eq. (|30|) that produces 
a bounded state in the variable 9i when the network is 
complete synchronous to an equilibrium point. In such 
case, 9i becomes constant, and Eq. pOI) has one stable 
equilibrium 9i — arcsin^^^, obtained when pi > w^. 

But, the local mean field becomes constant due to com- 
plete synchronisation and not due to the fact that the 
nodes are "decoupled" . These conditions do not produce 
the CAS phenomenon. 



F. Preserving the CAS pattern in different 
networks: a way to predict the onset of the CAS 
phenomenon in larger networks 

Consider two networks, ni and n2, whose nodes have 
equal dynamical descriptions, the network ni with A'^i 
nodes and the network rt2 with N2 nodes (7V2 > A^i), 
and two nodes, i in the network ni and j in the network 
n2. Furthermore, assume that both nodes have stable 
periodic CAS patterns (criteria 1 is satisfied), and as- 
sume that the nodes have sufficiently large degrees such 
that the local mean field of node i is approximately equal 
to node j. Then the CAS pattern of node i will be ap- 
proximately the same as the one of node j if 

a'^-^^(ni)A:,(ni) = aC^^K)^^). (31) 

(j'--^^^{ni) and (7'~^^^{n2) represent the largest coupling 
strengths for which the variance of the local mean field of 
a node decays with the inverse of the degree of the node 
(criterion 2 is satisfied) in the networks, respectively, 
and fci(ni) and kj{n2) are the degrees of the nodes i and 
j, respectively. In other words, the CAS phenomenon 
occur in the network if cr < a'~^^^ . 

Therefore, if cr'^'^'^ ( A^i ) is known, a^'^^{N2) can be 
calculated from Eq. (I5T|) . In other words, if the CAS 
phenomenon is observed at node i for a < a'~^^^{Ni)^ 
the CAS phenomenon will also be observed at node j for 
ct("2) < cF'~^^^{n2), where a'-^^^{n2) satisfies Eq. ((5T|) . 
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